Reward processing in autism: a thematic series

This thematic series presents theoretical and empirical papers focused on understanding autism from the perspective of reward processing deficits. Although the core symptoms of autism have not traditionally been conceptualized with respect to altered reward-based processes, it is clear that brain reward circuitry plays a critical role in guiding social and nonsocial learning and behavior throughout development. Additionally, brain reward circuitry may respond to social sources of information in ways that are similar to responses to primary rewards, and recent clinical data consistently suggest abnormal behavioral and neurobiologic responses to rewards in autism. This thematic series presents empirical data and review papers that highlight the utility of considering autism from the perspective of reward processing deficits. Our hope is that this novel framework may further elucidate autism pathophysiology, with the ultimate goal of yielding novel insights with potential therapeutic implications

Reward and punishment learning in daily life:A replication study

Day-to-day experiences are accompanied by feelings of Positive Affect (PA) and Negative Affect (NA). Implicitly, without conscious processing, individuals learn about the reward and punishment value of each context and activity. These associative learning processes, in turn, affect the probability that individuals will re-engage in such activities or seek out that context. So far, implicit learning processes are almost exclusively investigated in controlled laboratory settings and not in daily life. Here we aimed to replicate the first study that investigated implicit learning processes in real life, by means of the Experience Sampling Method (ESM). That is, using an experience-sampling study with 90 time points (three measurements over 30 days), we prospectively measured time spent in social company and amount of physical activity as well as PA and NA in the daily lives of 18-24-year-old young adults (n = 69 with anhedonia, n = 69 without anhedonia). Multilevel analyses showed a punishment learning effect with regard to time spent in company of friends, but not a reward learning effect. Neither reward nor punishment learning effects were found with regard to physical activity. Our study shows promising results for future research on implicit learning processes in daily life, with the proviso of careful consideration of the timescale used. Shortterm retrospective ESM design with beeps approximately six hours apart may suffer from mismatch noise that hampers accurate detection of associative learning effects over time

Temporal and effort cost decision-making in healthy individuals with subclinical psychotic symptoms

The value people attribute to rewards is influenced both by the time and the effort required to obtain them. Impairments in these computations are described in patients with schizophrenia and appear associated with negative symptom severity. This study investigated whether deficits in temporal and effort cost computations can be observed in individuals with subclinical psychotic symptoms (PS) to determine if this dysfunction is already present in a potentially pre-psychotic period. Sixty participants, divided into three groups based on the severity of PS (high, medium and low), performed two temporal discounting tasks with food and money and a concurrent schedule task, in which the effort to obtain food increased over time. We observed that in high PS participants the discounting rate appeared linear and flatter than that exhibited by participants with medium and low PS, especially with food. In the concurrent task, compared to those with low PS, participants with high PS exerted tendentially less effort to obtain snacks only when the required effort was high. Participants exerting less effort in the higher effort condition were those with higher negative symptoms. These results suggest that aberrant temporal and effort cost computations might be present in individuals with subclinical PS and therefore could represent a vulnerability marker for psychosis

Behavioral modeling of human choices reveals dissociable effects of physical effort and temporal delay on reward devaluation

There has been considerable interest from the fields of biology, economics, psychology, and ecology about how decision costs decrease the value of rewarding outcomes. For example, formal descriptions of how reward value changes with increasing temporal delays allow for quantifying individual decision preferences, as in animal species populating different habitats, or normal and clinical human populations. Strikingly, it remains largely unclear how humans evaluate rewards when these are tied to energetic costs, despite the surge of interest in the neural basis of effort-guided decision-making and the prevalence of disorders showing a diminished willingness to exert effort (e.g., depression). One common assumption is that effort discounts reward in a similar way to delay. Here we challenge this assumption by formally comparing competing hypotheses about effort and delay discounting. We used a design specifically optimized to compare discounting behavior for both effort and delay over a wide range of decision costs (Experiment 1). We then additionally characterized the profile of effort discounting free of model assumptions (Experiment 2). Contrary to previous reports, in both experiments effort costs devalued reward in a manner opposite to delay, with small devaluations for lower efforts, and progressively larger devaluations for higher effort-levels (concave shape). Bayesian model comparison confirmed that delay-choices were best predicted by a hyperbolic model, with the largest reward devaluations occurring at shorter delays. In contrast, an altogether different relationship was observed for effort-choices, which were best described by a model of inverse sigmoidal shape that is initially concave. Our results provide a novel characterization of human effort discounting behavior and its first dissociation from delay discounting. This enables accurate modelling of cost-benefit decisions, a prerequisite for the investigation of the neural underpinnings of effort-guided choice and for understanding the deficits in clinical disorders characterized by behavioral inactivity

Do regional brain volumes and major depressive disorder share genetic architecture?:A study of Generation Scotland (<i>n</i>=19,762), UK Biobank (<i>n</i>=24,048) and the English Longitudinal Study of Ageing (<i>n</i>=5,766)

Major depressive disorder (MDD) is a heritable and highly debilitating condition. It is commonly associated with subcortical volumetric abnormalities, the most replicated of these being reduced hippocampal volume. Using the most recent published data from Enhancing Neuroimaging Genetics through Meta-analysis (ENIGMA) consortium's genome-wide association study of regional brain volume, we sought to test whether there is shared genetic architecture between seven subcortical brain volumes and intracranial volume (ICV) and MDD. We explored this using linkage disequilibrium score regression, polygenic risk scoring (PRS) techniques, Mendelian randomisation (MR) analysis and BUHMBOX. Utilising summary statistics from ENIGMA and Psychiatric Genomics Consortium, we demonstrated that hippocampal volume was positively genetically correlated with MDD (rG=0.46, P=0.02), although this did not survive multiple comparison testing. None of the other six brain regions studied were genetically correlated and amygdala volume heritability was too low for analysis. Using PRS analysis, no regional volumetric PRS demonstrated a significant association with MDD or recurrent MDD. MR analysis in hippocampal volume and MDD identified no causal association, however, BUHMBOX analysis identified genetic subgrouping in GS:SFHS MDD cases only (P=0.00281). In this study, we provide some evidence that hippocampal volume and MDD may share genetic architecture in a subgroup of individuals, albeit the genetic correlation did not survive multiple testing correction and genetic subgroup heterogeneity was not replicated. In contrast, we found no evidence to support a shared genetic architecture between MDD and other regional subcortical volumes or ICV

Diazepam actions in the VTA enhance social dominance and mitochondrial function in the nucleus accumbens by activation of dopamine D1 receptors.

Benzodiazepines can ameliorate social disturbances and increase social competition, particularly in high-anxious individuals. However, the neural circuits and mechanisms underlying benzodiazepines' effects in social competition are not understood. Converging evidence points to the mesolimbic system as a potential site of action for at least some benzodiazepine-mediated effects. Furthermore, mitochondrial function in the nucleus accumbens (NAc) has been causally implicated in the link between anxiety and social competitiveness. Here, we show that diazepam facilitates social dominance, ameliorating both the competitive disadvantage and low NAc mitochondrial function displayed by high-anxious rats, and identify the ventral tegmental area (VTA) as a key site of action for direct diazepam effects. We also show that intra-VTA diazepam infusion increases accumbal dopamine and DOPAC, as well as activity of dopamine D1- but not D2-containing cells. In addition, intra-NAc infusion of a D1-, but not D2, receptor agonist facilitates social dominance and mitochondrial respiration. Conversely, intra-VTA diazepam actions on social dominance and NAc mitochondrial respiration are blocked by pharmacological NAc micro-infusion of a mitochondrial complex I inhibitor or an antagonist of D1 receptors. Our data support the view that diazepam disinhibits VTA dopaminergic neurons, leading to the release of dopamine into the NAc where activation of D1-signaling transiently facilitates mitochondrial function, that is, increased respiration and enhanced ATP levels, which ultimately enhances social competitive behavior. Therefore, our findings critically involve the mesolimbic system in the facilitating effects of diazepam on social competition and highlight mitochondrial function as a potential therapeutic target for anxiety-related social dysfunctions

Dopaminergic modulation of affective and social deficits induced by prenatal glucocorticoid exposure

Prenatal stress or exposure to elevated levels of glucocorticoids (GCs) can impair specific neurobehavioral circuits leading to alterations in emotional processes later in life. In turn, emotional deficits may interfere with the quality and degree of social interaction. Here, by using a comprehensive behavioral approach in combination with the measurement of ultrasonic vocalizations, we show that in utero GC (iuGC)-exposed animals present increased immobility in the forced swimming test, pronounced anhedonic behavior (both anticipatory and consummatory), and an impairment in social interaction at different life stages. Importantly, we also found that social behavioral expression is highly dependent on the affective status of the partner. A profound reduction in mesolimbic dopaminergic transmission was found in iuGC animals, suggesting a key role for dopamine (DA) in the etiology of the observed behavioral deficits. Confirming this idea, we present evidence that a simple pharmacological approach—acute L-3,4-dihydroxyphenylacetic acid (L-DOPA) oral administration, is able to normalize DA levels in iuGC animals, with a concomitant amelioration of several dimensions of the emotional and social behaviors. Interestingly, L-DOPA effects in control individuals were not so straightforward; suggesting that both hypo- and hyperdopaminergia are detrimental in the context of such complex behaviors.This work was supported by a grant of Institute for the Study of Affective Neuroscience (ISAN) and Janssen Neurosciences Prize. SB and AJR have Fundacao para a Ciencia e Tecnologia (FCT) fellowships (SFRH/BD/89936/2012; SFRH/BPD/33611/2009)

Role of Dopamine D2 Receptors in Human Reinforcement Learning

Influential neurocomputational models emphasize dopamine (DA) as an electrophysiological and neurochemical correlate of reinforcement learning. However, evidence of a specific causal role of DA receptors in learning has been less forthcoming, especially in humans. Here we combine, in a between-subjects design, administration of a high dose of the selective DA D2/3-receptor antagonist sulpiride with genetic analysis of the DA D2 receptor in a behavioral study of reinforcement learning in a sample of 78 healthy male volunteers. In contrast to predictions of prevailing models emphasizing DA's pivotal role in learning via prediction errors, we found that sulpiride did not disrupt learning, but rather induced profound impairments in choice performance. The disruption was selective for stimuli indicating reward, while loss avoidance performance was unaffected. Effects were driven by volunteers with higher serum levels of the drug, and in those with genetically-determined lower density of striatal DA D2 receptors. This is the clearest demonstration to date for a causal modulatory role of the DA D2 receptor in choice performance that might be distinct from learning. Our findings challenge current reward prediction error models of reinforcement learning, and suggest that classical animal models emphasizing a role of postsynaptic DA D2 receptors in motivational aspects of reinforcement learning may apply to humans as well.Neuropsychopharmacology accepted article peview online, 09 April 2014; doi:10.1038/npp.2014.84